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BACKGROUND 

(1) Field of the Invention 

The invention relates to three-dimensional imaging. More specifically, the 
invention relates to capture and distribution of three-dimensional digital images. 

(2) Background 

Various non-contact methods for creating three-dimensional models of 
three-dimensional objects exist. There are four broad categories of non-contact 
three-dimensional digitizers. The first category is referred to as silhouette digitizers 
because the imaging device repeatedly takes the silhouette of the object as the object 



jjl is rotated before the imaging device or the imaging device is rotated about the object. 

O 

This type of digitizer is relatively ineffective at dealing with concavities in a 

t' 

H three-dimensional object because the silhouette is unchanged by the concavity. 

^ The second category is timing digitizers. Timing digitizers use a signal source 

nfe such as a radar source. By determining the amount of time required for the signal to 



bounce back from the different points on the target object, surface features of the 
object are revealed. However, such digitizing methods are extremely expensive to 
implement. 

A third category is projected pattern digitizers, in which a pattern of some sort 
20 is projected onto the object to be digitized and the dimensions of the object are 
determined from the interaction of the pattern with the object. Projected pattern 
digitizers fall into three main subcategories. The subcategories include contour 
digitizers which use spatial distortion from a projected pattern of contour lines to 
determine surface features of a three-dimensional object. A next subcategory is 
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interference projected pattern digitizers, which use two sources and then based on 
the locaHzed interference pattern of the two sources, determine the surface features 
of the three-dimensional object to be digitized. A third subcategory is referred to as 
color projected pattern digitizers because this category uses a projected color pattern 
and resulting color gradients to determine relevant information about the object to 
be digitized. 

A final broad category is stereoscopic digitizers which employ multiple 
cameras to capture images of the object from different angles. From the picture, 
such systems perform feature identification. Then a correlation between the 
features in the different pictures is established to yield three-dimensional data. 

Common to all of these various methods are high cost and that each typically 
mandates a highly constrained environment often requiring a lab-like setting in 
which to perform the imaging in order to attain necessary alignments. This cost and 
difficulty of use render such systems impractical for use by the average user. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The invention is illustrated by way of example and not by way of limitation 
in the figures of the accompanying drawings in which like references indicate 
similar elements. It should be noted that references to "an" or "one" embodiment 
in this disclosure are not necessarily to the same embodiment, and such references 
mean at least one. 

Figure 1 is a block diagram of a system of one embodiment of the invention. 
Figure 2 is a block diagram of a system of one embodiment of the invention. 
Figure 3 is a block diagram of an alternative embodiment of the invention. 
Figure 4 is a flow diagram of operation of the host in one embodiment of the 
invention. 

Figure 5 is a flow diagram of operation at a server node in one embodiment 
of the invention. 

Figure 6 is a flow diagram of operation in a digitizer in one embodiment of 
the invention. 

Figure 7 is a flow diagram of setup and data capture in a digitizer of one 
embodiment of the invention. 
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DETAILED DESCRIPTION 



> 



Figure 1 is a block diagram of a system of one embodiment of the invention. 
The distributed network 100 such as the Internet provides an intercormection 
between a plurality of user nodes 110, a server node 120 and a host 150. Server node 
120 may be any conventional server or a collection of servers to handle traffic and 
requestss^j^ the distributed network. User nodes may be discrete computers 
rurming on their web^facowser, a corporate network, another server site, or any other 
node on the distributed network>iipst 150 may be a computer (laptop, desktop, 
hand-held, server, workstation, etc.), an internet appliance or any other device 
through which data may be forwarded across the distributed network. 

TRfe4iost 150 may communicate over a large wire link such as a universal 
serial bus (USB) o^'v^ireless link 162 to a digitizer 170. The digitizer 170 may be any 
of the myriad noncontact digitizers. One suitable digitizer is described in copending 
patent application Serial No. ^ , entitled DIGITIZER USING INTENSITY 
GRADIENT TO IMAGE FEATURES OF TI^R^- DIMENSIONAL OBJECTS and 
assigned to the assignee of the instant application. 

In one embodiment, digitizer 170 is physically independent of an orientation 
fixture 180. For user convenience, it is desirable to minimize space permanently 
allocated to the system and minimize setup time. Most users will not be able to 
allocate sufficient space to leave the system configured for use at all times. The user 
will therefore be required to reintroduce some portion of the system prior to each 
use. l^ieTi5&d-tQ..swap cables and otherwise rewire serves as a significant deterrent 
to wide spread consumer adoptiCm^ 
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As used herein, "physically independent'' means that no mechanical or wired 
electrical connection must exist between the physically independent units during 
operation. By way of example and not limitation, two devices coupled together by 
an electrical signaling wire either directly or through a host computer, are not 



communicate over a wireless link are deemed ''physically independent." 
Connection to a common power source, e.g., two outlets in a house, is not deemed 
to destroy physical independence. 

Orientation fixture 180 repositions an object to be digitized by digitizer 170 



-Mo such that different aspects of the object are exposed relative to the digitizer at 
0^ different points in time. In one embodiment the orientation fixture 180 is a 



an object relative to the digitizer are deemed to be within the ambit of orientation 
fixtures. 

As previously noted the orientation fixture is physically independent of the 
20 digitizer. One premise of the system is relative ease of setup to facilitate wide 

acceptance. Thus, with the physical independence it is desirable that the digitizer 
170 and orientation fixture 180 be able to "find" each other. To that end, the digitizer 
170 may be equipped to sweep an area looking with its sensing apparatus for a 



5 physically independent, whereas two devices that have no physical coupling and 




tects of 
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feature of the orientation fixture 180. The orientation fixture 180 may include a 
feature such as indicia, for example, acquisition indicia 188, or may contain some 
other physically observable structure that permits the digitizer to identify and 
acquire the orientation fixture 180 without the user introducing or removing a 
separate reference object. Acquiring the orientation fixture may permit, for 
example, any of automatic calibration of the digitizer, automatic determination of 



the relative position of the digitizer and orientation fixture, and fixture's orientation 
or condition. In one embodiment, imaging the feature provides an indication of 
focal distance as the perspective of the feature varies in a known way with distance. 
Calibration may be performed by imaging the feature and comparing the results to a 
set of reference data corresponding to the feature. In this manner the digitizer 
settings can be automatically optimized to provide the best available accuracy under 
existing conditions. Alternatively, the calibration can be performed based on a 
reference target or path entirely within the digitizer. 

Alternatively, the orientation fixture may have a localized radiation source 
186, which permits the digitizer 170 to sweep and identify the location of the 
orientation fixture based on the localized radiation from radiation source 186. It is 
also within the scope and contemplation of the invention to have the orientation 
fixture 170 position itself relative to the digitizer, such that the orientation fixture 
controls the acquisition by the digitizer 170 of the orientation fixture 180 and the 
object to be oriented thereby. In the system of such embodiment the orientation 
fixture would likely be a mobile robotic unit. 
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In one embodinaent, the digitizer communicates with the orientation fixture 
across a wireless link 184 to coordinate the orientation of the object with image 
capture by the digitizer. The wireless link may be infrared ("IR'O/ radio frequency 
("RF") , optical signaling, or any other mode of wireless communication. In one 
embodiment the orientation fixture 180 includes a self contained power source 194 
such as a battery. The self-contained power source 194 may also be a solar panel, 
fuel cell, or any other suitable power source. 

In one embodiment of the invention, digitizer 170 captures information 
about an object positioned by orientation fixture 180 from which a three- 
dimensional model can be derived. Controller 192 in digitizer 170 controls the 
coordination between the data capture by digitizer 170 and aspect change by the 
orientation fixture 180. It is within the scope and contemplation of the invention 
for the controller to reside in the host, the digitizer, the orientation fixture or in an 
independent unit. References to the controller herein are deemed to include 
without limitation all of these options. The digitizer 170 may also include a data 
analyzer 196 that reviews captured data to find errors, anomalies or other points of 
interest that warrant further investigation, including possibly rescanning the 
corresponding area. After any corrective action, the data captured by digitizer 170 is 
passed to the host 150, which renders the three-dimensional model from the data. 
The host 150 may perform compression or any other manipulation of the data 
known in the art. The three-dimensional model may then be sent over distributed 
network 100 to remote nodes such as user nodes 110 or a server node 120. This 
provides maximum ease of distribution across the distributed network 100. 
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u 



In some cases, control of distribution of information captured by the digitizer 
is desirable, for example, to facilitate administration of user fees. To that end, in one 
embodiment the digitizer is provided with a hardware interlock 190 which prevents 
the system from operating without first receiving authorization. Such 
authorization may be provided by the server node 120 sending authorization data 
across the distributed network. Alternative locking mechanisms such as software or 
firmware-based locking mechanisms may also be employed either within the 
digitizer 170 or the host 150. Further security of the system can be affected by 
requiring an imaging application 152 on the host 150 to provide a valid digital 
signature in addition to the authorization data before enabling capture and /or 

fri 

01 transfer of captured data from the digitizer 170 to the host 150. 

G 

^ Some embodiments of the digitizer 170 may encrypt the data captured prior to 

sending it to the host 150. In that event, unless the host is able to decrypt the data to 
Jfi render it, it may forward it on to the server node 120 across the distributed network 

U and subsequent rendering of the image or three-dimensional model would occur on 

I 

y the server node 120. In this marmer, the local user does not have access to the data 
from which the three-dimensional model may be derived unless a key is provided. 
In still another embodiment, the host 150 may include encryption capabilities and 
encrypt the rendered image before forwarding it on to the server node 120. Keying 
20 information may be provided to the digitizer and /or the host by the server node 120. 
^^i /}(^ The server node^ntay-fflaiiatai^^ and authorization data in a local 

data base 122. Once the three-dimensional d^taTr5afely:..c;Qr^^ by the server 
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node 120, access to the data may be made available for free or at cost to the user 
nodes 110 or back to the host 150. 

The digitizer may also include a field programmable gate array ("FPGA") or 
other reconfigurable logic unit. In such case, the server node periodically may 
reprogram the FPGA to implement an updated or enhanced algorithm for 
processing or security purposes, for example, as subsequently developed. 

Figure 2 is a block diagram of a subsystem of one embodiment of the 



invention. The suBsysTenr-et£igu^^ in place of host 150, digitizer 

120 and orientation fixture 180 of Figure 1. DigiHz5ri'^04a.COuple to a host 50. This 

O 

^ coupling may be by a bus 60 such as the Universal Serial Bus (USB), IEEE 1394 bus, or 

m 

pi any other suitable data transfer system. It is also within the scope and 

& contemplation of the invention for the digitizer to communicate with the host 

^ mode via a wireless interconnection. Host 50 may be a personal computer, a work 

n 

station, an internet appliance, or any other device that provides sufficient 

i| intelligence and processing power to render images from the data obtained by the 

□ 

p digitizer. The digitizer 70 captures image data and may forward it to the host 50 for 
rendering. In this way, the processing on the digitizer 70 may be limited, permitting 
lower cost construction. It is also within the scope and contemplation of the 
invention for the digitizer to render the image and deliver it directly to a distributed 

20 network. It is further within the scope and contemplation of the invention for the 
digitizer to deliver the data to a distributed network for rendering on a remote node. 

The digitizer 70 includes a projector to project a stripe of white light through a 
projection window 74 onto a remote object such as a person 82 on a turntable 80 
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remote from the digitizer. The digitizer also contains an image sensing array (ISA) 
aligned with an image capture window 76 which captures the image of the object 82 
within a focal zone. In one embodiment, the ISA is a linear charge coupled device 
(CCD) or complementary metal oxide semiconductor (CMOS) sensor, and the focal 
zone is a line on the target object. In some embodiments, the digitizer includes a 
base 72 about which the upper unit, including the projector and the ISA, can rotate 
in either direction. This permits the focal line to be swept back and forth across a 
target object through an arc. This sweeping reduces the loss of detail in the captured 
image that results from shadowing on the object from the perspective of an 

W immobile focal line. The digitizer 70 also includes a wireless interface to 

m 

communicate with a turntable 80 via a wireless link 84. 
i /^jiy \ Tumfeble...80jiiay be the type described in co-pending application entitled 

WIRELESS TURNTABLE, Serial^^No , assigned to the assignee of the 

instant application. Via wireless link 84, the digitizeF*§eH4s commands to the 



t§ turntable 80 and receives from the turntable indications of the aneufer^position of 

5 

^ the turntable surface relative to a home position. When the digitizer is activated, it 
searches for the turntable 80 by sending a signal to which the turntable 80 is required 
to respond. If the turntable responds, the digitizer looks for a predetermined pattern 
that is expected to be present on the turntable surface. For example, the pattern may 

20 be concentric circles on the turntable surface. In such case, based on the image 

captured, the digitizer can both find the turntable and determine its distance from 
the digitizer. Then after the response is received, the digitizer sends a "go home" 
signal to the turntable. In some embodiments, the digitizer sends acceleration and 
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rotation profiles to the turritable to control its rotation. Each profile may be retained 
in firmware on the digitizer or downloaded from host 50. 

Generally speaking, the projection portion of the digitizer 70 is retained in 
fixed relation to the imaging portion. The projection portion produces a light stripe 
as noted previously on the object 82. By either sweeping the light stripe back and 
forth through the focal line or by mechanically blocking the stripe at a known rate, 
the intensity gradient can be created. In one embodiment, the blocking is from 0% 
to 100% during a cycle. Because the ISA integrates the illumination over time, the 
outline of a three-dimensional surface is reflected in the data captured by the ISA. 
This is because protruding features will remain illuminated longer. Accordingly, 
more photons are captured by the ISA corresponding to those features. After 
repeating this process one stripe at a time as the object is rotated by turntable 80 or 
through the course of sweeping the entire digitizer back and forth as it rotates about 
the base, cost effective three-dimensional imaging is effected. The digitizer may 
also be used to capture high resolution scans of two dimensional objects by sweeping 
back and forth across the object. This feature is particularly desirable in the context 
of digitizing works of art. 
&^Jj^ Figure 3 is a block diagram of an alternative embodiment of the inventiwtr^ 
Again, in this embodiment user nodes 110 are coupled to a distribtlfed network 100. 
Also coupled to distributed node 100 is servejjftodg^O and host 150. However, 
rather than being physicallWjid^pendent in this embodiment, the digitizer 270 and 
orientation umtl&QTaxe coupled together to form a single integral unit. The unit 
communicates with the host by wireless link 262. Alternatively, the unit may be 
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wired to the host by a USB or any other suitable wired communication link.^^ 
digitizer may use a Hnear image sensor 200 to image an object on th^.<frientation 
fixture 280. A Ught source 274 may provide the lighting used>y the image sensing 
array to discern the three-dimensional data. By integFdnng the digitizer and 
orientation unit, setup of the system is sim^pjified. The digitizer may be rotatably 
coupled so that it can sweep its foc^i^ne back and forth across an object positioned 
by the orientation fixture 28p/'This embodiment is particular suitable for small-scale 
oBj^eta^ch as jewelry/m which the desired focal distance is relatively short. The 
other features distusged above in connection with Figure 1 may equally be applied to 
embodiments as shown in Fi^t*i:e 2. 

Figure 4 is a flow diagram of operation of the host in one embodiment of the 
invenHonTTte-ftmetioRaLhl^^ request authorization to scan from a 

remote node (such as the server node). At functionalBl0ck-4Q2, the host node 
receives authorization data across the distributed network. At functional block 404, 
the host forwards authorization data to the digitizer. At functional block 406 the 
host receives scan data from the digitizer. 

At decision block 408 a determination is made whether the three- 
dimensional model should be rendered locally. If the rendering should not occur 
locally the data is forwarded to a remote node at functional block 420. The 
forwarded data may be encrypted or unencrypted, compressed or not compressed, 
and the forwarding protocol may be cell-based, packet-based or any other 
transmission protocol commonly used on distributed networks. 
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If the rendering should occur locally, a determination is made at decision 
block 422 if the data is encrypted. If the data is not encrypted at decision block 422, 
the image or three-dimensional model is rendered from the data at functional block 
412. A determination is then made at decision block 414 whether the rendered 
5 model should be stored locally. If it is determined that the model should be stored 
locally, the model is stored on the host at functional block 416. If it is determined 
that the model should not be stored locally, the rendered model is forwarded to the 
remote node at functional block 418. In some cases, if the image is stored locally, it 
may not be forwarded to the remote node. In one embodiment of the invention, 

O 

^ the authorization data indicates if local storage is permitted. If local storage is not 

01 permitted, the imaging application may be made responsible for electronic 

P 

shredding of any temporary buffer space used in forwarding the scarmed data. 

^ If at decision block 422 it is determined that the data is encrypted, a request is 

O 

made across the distributed network for keying information (or other information 
that permits decryption) from the remote node at functional block 424. The request 
B may include payment for access privileges. Once the keying information is received 
at functional block 426, the host is able to decrypt the data at functional block 428. 
The flow then continues at functional block 412 as above described. 

Figure 5 is a flow diagram of operation at a server node in one embodiment 
20 of the invention. At functional block 500 the server node receives a request for scan 
authorization. A determination is made at decision block 502 if the requesting 
account is in good standing. If it is not, authorization is declined at functional block 
526. If the account is in good standing, the authorization data is sent to the requester 
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at functional block 504. A determination is made at decision block 506 if the 
requester is to render the image. If the requester is to render the image, a 
determination is made at decision block 508 whether encryption is required. 
Requiring encryption may be at the option of the server node as part of the use 
authorization. If encryption is required, the server receives a request to decrypt at 
functional block 510. The server node may then send keying information (or other 
information that permits decryption) to the requester at functional block 512. If no 
encryption is required or after the keying information has been sent, the server node 
may receive the rendered three-dimensional model at functional block 514. 

If at decision block 506 the requester is not to render the image, the server 
node receives the scan data and decrypts as necessary at functional block 516. The 
server then renders the three-dimensional model at functional block 518. After the 
three-dimensional model is rendered by the server or received by the server, the 
model is stored for subsequent distribution at functional block 520. Once stored, the 
server may provide the model to any arbitrary node or the distributed netv^ork. 

At functional block 522, the request is received for access to a model. At 
decision block 524 a determination is made whether to allow access to the model to 
the requester. Such a determination may be made based on predetermined access 
privilege to different models, including whether the requester was the creator of the 
model, access privilege level established by the creator, or based on some payment 
for such access. If it is determined that access to the model should be allowed, the 
model is sent to the requester at functional block 526. The model may be sent in any 
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form and may be encrypted for security. In some embodiments the requestor may be 
given the option of the file type sent. Otherwise, access to the request is declined. 

Figure 6 is a flow diagram of operation in a digitizer in one embodiment of 
the invention. At functional block 600, authorization data is received from the host. 
The determination is made at functional block 602 if the authorization data is valid. 
Authorization data may include a code and, for example, a digital signature for the 
imaging application to ensure that an authorized imaging application is operating 
on the host. If the authorization data is valid, the image capture system is unlocked 
and enabled at functional block 604. At functional block 606, the digitizer captures 
scan data for the object positioned by the orientation fixture. A determination is 
then made at decision block 608 whether the scan data should be secured. If the scan 
data should be secured, the digitizer may encrypt the data at functional block 612. If 
the data need not be secured or after encryption, the scan data may be sent to the 
host at functional block 614. At functional block 616, the image capture system is 
relocked. 

In one embodiment the server node is able to control both the enablement of 
the imaging subsystem to operate and access to the data subsequently captured. This 
permits remote control of a widely distributed network of imaging subsystem 
having broad user appeal due to low cost and ease of operation. 

Figure 7 is a flow diagram of setup and data capture in a digitizer in one 
embodiment of the invention. At functional block 702, the digitizer scans for the 
orientation fixture. In one embodiment, this may take the form of the digitizer 
sweeping an arc around it looking for a distinctive feature. At functional block 704, 
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the digitizer acquires the orientation fixture. At functional block 706, the digitizer 
identifies a feature on the digitizer from which it can derive certain information. A 
featured datum is located at functional block 708. The featured datum provides a 
reference from which, e.g., the center of the turntable, may be located. At functional 
block 710, feature distortion is compared to a saved reference value, for example, 
this distortion may either be of the feature or of the entire orientation fixture. Based 
on this comparison, the relative position is calculated at functional block 712. At 
functional block 714, the same distortion can be used to calculate and set calibration 
data to optimize the accuracy of subsequent scans based on existing conditions. At 
functional block 716, the digitizer becomes ready to scan. 

At functional block 718, the digitizer begins to scan and capture data from 
which a three-dimensional model of the object being scanned may be derived. At 
decision block 720, a determination is made if the scan is complete. If the scan is not 
complete, a determination is made at decision block 722 if the partial scan is corrupt, 
anomalous, or otherwise unusable. If the data is not usable, a partial rescan may be 
performed for that region of the object at functional block 724. If at decision block 
720 the scan is complete, the scan data is analyzed to identify points of interest. At 
functional block 726, those points of interest may include anomalous data, errors, 
features for which greater resolution is desirable, or any other facet of the object that 
warrants further investigation or review. A determination is made at decision 
block 728 whether any points of interest are present. If there are points of interest 
present, a determination is made at decision block 730 if all points of interest have 
been addressed. If all points of interest have not been addressed at functional block 
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732, the system rescans a portion of the object corresponding to a point of interest. 
This rescan may be conducted at a higher resolution than the original scan, the same 
resolution as the original scan, or even using an alternative image capture method. 
At functional block 734, the model is adjusted based on the rescan. Flow then 
returns to decision block 730 to determine if all points of interest have been 
addressed. If they have, the system returns to identify points of interest at 
functional block 726. In this manner, if the rescan adjustment creates additional 
points of interest, those will subsequently be picked up and addressed. If at decision 
block 728 no points of interest are present, the system renders the image at 
functional block 736. 

In the foregoing specification, the invention has been described with 
reference to specific embodiments thereof. It will, however, be evident that various 
modifications and changes can be made thereto without departing from the broader 
spirit and scope of the invention as set forth in the appended claims. The 
specification and drawings are, accordingly, to be regarded in an illustrative rather 
than a restrictive sense. 
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